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one pixel, a half of a pixel or other fractional shift. 
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ABSTRACT 

The present invention relates to a method and system for performing motion estimation in 
video image compression. In accordance with the invention, an associative memory device is 
used in motion estimation, and the group of the image blocks to the processed is restricted on the 
basis of a mean error and the best match is searched among the image blocks using the PDE 
method. Thanks to the invention, motion estimation may be performed via software in a regular 
PC environment and still more efficiently than before. 
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PROCEDURE AND SYSTEM FOR PERFORMING MOTION ESTI MATION 
FIELD OF THE INVENTION 

The invention relates to video image compres- 
sion. In particular, the invention relates to a new 
and advanced method and system of performing motion 
estimation in conjunction with video image compres- 
sion. 



PRIOR ART 

Previously known are several methods of video 
image compression. For most of the methods, motion es- 
timation is the stage demanding the most time and com- 
puting efficiency. The main principal of motion esti- 
mation is as follows. A video image consists of suc- 
cessive frames in a time level. Each frame is divided 
into image blocks of certain size. Typically a block 
is, e.g. the size of eight by eight pixels. When cod- 
ing a frame, e.g. for transmission it is being proc- 
essed block by block. However, instead of transmitting 
each block of each frame as such, an attempt is made 
to search from the previous frame, in the area of the 
image block being worked, in so called search area, a 
block either exactly matching with or in a certain 
scope close to the current block. In case this kind of 
image block is found, just the motion vector, i.e. 
vector denoting the location of the found block in re- 
lation to the original one is transmitted instead of 
transmitting the whole block of information. The 
amount of the information to be sent is thereby re- 
markably reducing. 

One other method used in conjunction with 
video compression is vector quantization. It differs 
from motion estimation in that the matching tag for 
the block to be coded is searched from a predetermined 
code book, instead of searching it from the previous 
frame. The code book is typically a group of most com- 



monly appearing image blocks. The same code book is 
naturally used both for the encoders and decoders. 

Although using motion estimation and vector 
quantization remarkably helps to reduce the amount of 
the information to be transmitted, there are, however, 
certain problems associated with them. Typically, es- 
pecially the search phase is time-consuming. The com- 
plexity of search increases in relation to the square 
of the page length of the search area. Therefore, at- 
tempts have been made to develop different methods us- 
ing which the search may be made fastener. The follow- 
ing publications disclose examples of methods with the 
intent to fasten motion estimation and vector quanti- 
zation either by focusing on enhancing the search al- 
gorithms or using some other means: S. T. Valli, "Very 
Low Bitrate Coding Using Hierarchical Classified VQ 
and Cluster Based Segmentation of Motion Information", 
paper No. 7.3, VLBV94, University of Essex, UK, April 
1994; H. Li, A. Lundmark, R. Forchheimer, "Image Se- 
quence Coding at Very Low Bitrates: A Review", IEEE 
Transactions on Image Processing, Vol.3, No. 5, Septem- 
ber 1994; H. Abut, ed. , "Vector Quantization", IEEE 
Press, 1990; G. Poggi, "Fast Algorithm for Full-Search 
VQ Encoding", Electronic Letters, Vol, 29, No .123, June 
1993; C.-M. Huang, Q. Bi, G. S. Stiles, R. W. Harris, 
"Fast Full Search Equivalent Encoding Algorithms for 
Image Compression Using Vector Quantization", IEEE 
Transactions on Image Processing, Vol.1, No. 3, July 
1992. 

When using the present methods the search 
area is at maximum typically + 15 pixels of the point 
of origin of the block to be coded. And even in that 
case the search is so complex that carrying out it via 
software is generally speaking not even possible, in- 
stead expensive device-based solutions have to be 
used, such as specific signal processing circuits. 
However, shifts even bigger than the + 15 pixels men- 



tioned in conjunction with the applications of low 
transfer rate/ low image frequency are common during 
the motion. Thus, there is a need for more efficient 
methods • 

The objective of the present invention is to 
disclose a method and system that would eliminate the 
drawbacks mentioned above. One specific objective of 
the invention is to disclose a method and system that 
makes it possible to perform motion estimation in a 
regular PC environment and at the same time more effi- 
ciently than before. 

StnOiZyE^Y OF TEE INVEimON 

The method of the present invention for per- 
forming motion estimation in video image compression 
comprises the following stages. On frame an image 
block that is wished to be coded is determined. On 
frame N-1 prior to the aforementioned frame N, a 
search area of motion vectors corresponding to the lo- 
cation of the block in question is determined. The 
image block average values are determined in every 
possible location area of the image blocks included in 
the aforementioned search area using a shift of prede- 
termined size. After this, based on the image block 
average values of the image blocks, the image blocks 
included in the aforementioned search area are ar- 
ranged in a predetermined order. Previously known is a 
method of performing the aforementioned arrangement by 
using different sorting algorithms. The disadvantage 
associated with the algorithms in question is, how- 
ever, their slowness. Next, an alternative best match- 
ing with the image block to be coded is searched among 
the image blocks of the search area in question. The 
maximum correspondence may be determined, e.g. using a 
minimum error, i.e. the blocks with the smallest error 
between them are best matching with each other. 



The determining of the image block average 
values is used herein to mean that in a preferred 
case, the image block average values computed and 
stored already in connection with the coding of the 
previous image blocks are retrieved from a specific 
image block average value memoxy. This is possible be- 
cause the search area determined for the image block 
to be coded is typically partly the same as the search 
area corresponding to the previous coded image blocks 
for which the determining of image block average val- 
ues and storing in the memory in question has already 
happened. If however, motion estimation is not used in 
coding the previous image blocks or if the image block 
average value cannot be found in the aforementioned 
memory, so the image block average value is computed 
and stored in the memory in question. 

In the advantageous procedure presented above 
the image block average values of frame N-1 are com- 
puted and stored as the image blocks of frame N are 
being coded. The image block average values may, how- 
ever, be computed and stored in one go before coding 
the image blocks. This is, however, not preferable be- 
cause motion estimation requiring computing of the im- 
age block average values is not necessarily performed 
in coding every image block. 

In accordance with the invention, the image 
blocks included in the search area are sorted by stor- 
ing the image block average values of the image blocks 
in question in the memory locations of the directory 
memory of an associative memory device in an ascending 
or descending order and by storing in the memory loca- 
tion of the output memory corresponding to each memory 
location of the directory memory the location data of 
the image blocks whose image block average value cor- 
responds to the value stored in the memory location of 
the directory memory in question. As a key word of the 
aforementioned associative memory device, the image 



block average value of the image block to be coded is 
used. 

An associative memory device is used herein 
to mean a digital memory device, such as, e.g. a mem- 
ory chip in which the regular address coding logic has 
been substituted with a specific directory memory. The 
directory memory consists of memory locations with, 
e.g. a certain character string stored in each one of 
them. In addition, the associative memory device in- 
cludes output memoi^r in the memory locations of which 
the actual data is typically stored. Each one of the 
memory locations of the output memory is associated 
with one or more memory locations of the directory 
memory. A certain key word, which might be, e.g. a 
character string, is given to the memory to serve as 
an input. In case a matching tag with the key word is 
found in some memory location of the directory memory, 
as output is received the content of the memory loca- 
tion of the output memory corresponding to the memory 
location of the directory memory in question. An exam- 
ple of an associative memory device is CAM (Content 
Addressable Memory, CAM) . A more detailed description 
of an associative memory device can be found, e.g. in 
the publication T. Kohonen, "Self -Organization and As- 
sociative Memory", Springer- Verlag, 1984. 

Further in accordance with the invention, the 
group of the image blocks to be processed is re- 
stricted on the basis of a mean error in accordance 
with the following equation: 

yA={yr'%-^^\^D^J, in which 

represents the restricted group of the im- 
age blocks to be processed, 

is the candidate block i, 

image block average value of the 
image block to be coded. 

|, is the image block average value of the 
candidate block i, and 



^min error of the best candidate block 

per each pixel . 

^min computed, e,g. as an RMS error or 

as a MAD error (Root -Me an -Squared, RMS; Mean-Absolute- 
Distortion, MAD) . A more detailed description of re- 
striction on the basis of mean error can be found, 
e.g. in the aforementioned publications C.-M. Huang, 
Q. Bi, G. S. Stiles, R. w, Harris, "Fast Full Search 
Equivalent Encoding Algorithms for Image Compression 
Using Vector Quantization", IEEE Transactions on Image 
Processing, Vol.1, No, 3, July 1992 and G. Poggi, "Fast 
Algorithm for Full -Search VQ Encoding", Electronic 
Letters, Vol.29, No. 123, June 1993. 

Furthermore in accordance with the invention, 
the best match is searched among the blocks included 
in the restricted group of images in question by using 
the PDE method (Partial Distance Elimination, PDE) . 
PDE is a method known in itself, which is used, e.g. 
in vector quantization for fastening the search. The 
error between the image block to be coded and the can- 
didate block is computed normally pixel by pixel. If 
the error exceeds the minimum error up to that stage, 
the computing is stopped and the comparison is done in 
the next candidate block. 

In an embodiment of the invention, a prede- 
termined area of regular shape around the image block 
to be coded is used as search area. The search area is 
typically, e.g. the shape of a quadrangle. 

In an embodiment of the invention, an area is 
defined that is comprised of an area of one or more 
objects moving fast between successive image frames, 
and the said area is used as search area. 

In an embodiment of the invention, the possi- 
ble location areas are defined by using a shift of one 
pixel, a half of a pixel or some other fractional 
shift. 



The advantage of the present Invention when 
compared with the prior art is that it remarkably fas- 
tens motion estimation and thereby makes it possible 
to perform motion estimation via software in a regular 
PC environment and still more efficiently than before. 
Since motion estimation may be performed via software, 
there is no need for expensive device-based solutions, 
and therefore, by the aid of the invention, motion es- 
timation may be made more advantageous than before. 

LIST OF FIGURES 

In the following section, the invention is 
described by way of examples of its embodiments with 
reference to the attached drawing, wherein 

Fig. 1 represents a system of the invention 
described in a block diagram. 

DETAILED DESCRIPTION OF THE INVENTION 

Fig -misrepresents the components of a system 
of the invention. The system has been implemented, 
e.g. in a form of programmable components in a regular 
PC device. The system comprises means of determining 1 
using which the image block average values are deter- 
mined in the location areas of the image blocks in- 
cluded in the search area corresponding to the loca- 
tion of the image block to be coded, means of sorting 
2 using which the image blocks are sorted on the basis 
of their image block average values, and means of 
searching 3 using which an alternative best matching 
with the image block to be coded is searched among the 
image blocks. The means of determining 1 comprise an 
image block average value memory (not presented) , 
wherein the computed image block average values are 
stored and where they are retrieved from in case 
needed. In practice, the image block average value 
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memory may be, e.g. a certain part of the memory space 
of a PC device. 

In accordance with the invention, the system 
comprises a CAM memory 2 by means of which the image 
blocks are sorted by storing their image block average 
values in the memory locations of the directory memory 
in an ascending or descending order and by storing in 
the memory location of the output memory corresponding 
to each memory location of the directory memory the 
location data of the image blocks whose image block 
average value corresponds to the value stored in the 
memory location of the directory memory in question. 
In practice, the CAM memory 2 is advantageously a cer- 
tain part of the memory space of a PC device, but it 
may be, e.g. a separate memory chip. Further in accor- 
dance with the invention, the system comprises means 3 
for restricting the group of the image blocks to be 
coded on the basis of a mean error, and means 3 for 
searching among the image blocks included in the re- 
stricted group of images the best match by using the 
PDE method. 

On frame N, an image block that is wished to 
be coded is determined. On frame N-1 prior to the 
aforementioned frame N, a search area of motion vec- 
tors corresponding to the location of the block in 
question is determined. The image block average values 
are determined in every possible location area of the 
image blocks included in the aforementioned search 
area using a shift of predetermined size, such as a 
shift of one pixel, a half of a pixel or some other 
fractional shift. After this, the image blocks in 
question are arranged in a predetermined order on the 
basis of their image block average values and an al- 
ternative best matching with the image block to be 
coded is searched among the image blocks of the search 
area in question. The maximum correspondence may be 
determined, e.g. using a minimum error, i.e. the 



blocks with the smallest error between them are best 
matching with each other. 

In practice, the determining of image block 
average values happens by retrieving the image block 
average values computed and stored already in connec- 
tion with the coding of the previous image blocks from 
a specific image block average value memory. This is 
possible because the search area determined for the 
image block to be coded is typically partly the same 
as the search area corresponding to the previous coded 
image blocks for which the determining of image block 
average values and storing in the memory in question 
has already happened. If however, motion estimation is 
not used in coding the previous image blocks or if the 
image block average value cannot be found in the 
aforementioned memory for some reason or other, so the 
image block average value is computed and stored in 
the memory in question. 

In the advantageous procedure presented above 
the image block average values of frame N-l are com- 
puted and stored as the image blocks of frame N are 
being coded. The image block average values may, how- 
ever, be computed and stored in one go before coding 
the image blocks. This is, however, not preferable be- 
cause motion estimation requiring computing of the im- 
age block average values is not necessarily performed 
in coding every image block. 

In accordance with the invention, the image 
blocks are sorted by storing their image block average 
values in the memory locations of the directory memory 
of the CAM memory 2 in an ascending or descending or- 
der. Further, the location data of the image blocks 
whose image block average value corresponds to the 
value stored in the memory location of the directory 
memory in question is stored in the memory location of 
the output memory corresponding to each memory loca- 
tion of the directory memory. As a key word of the CAM 
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memory 2, the image block average value of the image 
block to be coded is used. As search area, a predeter- 
mined area of regular shape aroimd the image block to 
be coded is used. The search area is, e.g. the shape 
of a quadrangle. Alternatively, the search area may be 
an area comprised of an area formed by one or more ob- 
jects moving fast between successive frames. 

The invention is not restricted to 
the examples of its embodiments presented above, in- 
stead many variations are possible within the scope of 
the inventive idea defined by the claims. One such 
variation is the using of the present invention for 
the searching of matching image blocks between the im- 
ages of a pair of stereo images (the left-hand and 
right-hand image) . This procedure similar to motion 
estimation is described, e.g. in the publication I, 
Dinstein et al., "On the Compression of Stereo Images: 
Preliminary Results", Signal Processing 17 (1989), s. 
373-382. 
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CLAIMS 

1. A method for performing motion estimation 
in video image compression, which method comprises 
the following stages: 

the image block to be coded is detemined on 

frame N, 

the search area corresponding to the location 
of the image block in question is detemined on frame 
N-1, 

the image block average values are determined 
in the location areas of the image blocks included in 
the search area in question by using a shift of prede- 
termined size, 

the image blocks included in the search area 
in question are arranged in a predetermined order on 
the basis of the image block average values of the im- 
age blocks in question. 

an alternative best matching with the image 
block to be coded is searched among the image blocks 
of the search area in question, character- 
ised in that the method further comprises the fol- 
lowing stages: 

the image blocks included in the search area 
are sorted by storing the image block average values 
of the image blocks in question in the memory loca- 
tions of the directory memory of an associative memory 
device in an ascending or descending order and by 
storing in the memory location of the output memory 
corresponding to each memory location of the directory 
memory the location data of the image blocks whose im- 
age block average value corresponds to the value 
stored in the memory location of the directoary memory 
in question, 

as a key word of the aforementioned associa- 
tive memory device, the image block average value of 
the image block to be coded is used. 



the group of the image blocks to be processed 
is restricted on the basis of a mean error, and 

the best match is searched among the image 
blocks included in the restricted group of images by 
using the PDE method. 

2. Method as defined in claim 1, char- 
acterised in that the method further comprises 
the stage: 

as search area, a predetermined area of regu- 
lar shape around the image block to be coded is used. 

3- Method as defined in claim 1, char- 
acterised in that the method further comprises 
the following stages: 

an area is defined that is comprised of an 
area of one or more objects moving fast between suc- 
cessive image frames, 

and the said area is used as search area. 

4 . Method as defined in any one of claims 1 - 
3, characterised in that the method further 
comprises the following stage: 

the possible location areas of the image 
blocks are determined by using a shift of one pixel, a 
half of a pixel or other fractional shift. 

5. A system for performing motion estimation 
in video image compression, which system comprises: 

means of determining (1) by means of which 
the image block average values are determined in the 
location areas of the image blocks included in the 
search area corresponding to the location of the image 
block to be coded by using a predeteinnined shift on 
the image frame prior to the image frame including the 
image block to be coded in question, 

means of sorting (2) by using which the image 
blocks are sorted on the basis of the image block av- 
erage values of the image blocks in question, and 

means of searching (3) by using which the 
variant best matching with the image block to be coded 
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is searched among the image blocks, character- 
ised in that the system further comprises: 

an associative memory device (2) by means of 
which the image blocks included in the search area are 
sorted by storing the image block average values of 
the image blocks in question in the memory locations 
of the directory memory of the associative memory de- 
vice in question (2) in an ascending or descending or- 
der and by storing in the memory location of the out- 
put memory corresponding to each memory location of 
the directory memory the location data of the image 
blocks whose image block average value corresponds to 
the value stored in the memory location of the direc- 
to2:y memory in question, and the image block average 
value of the image block to be coded is used as a key 
word of the associative memory device (2) . 

means (3) for restricting the group of the 
image blocks to be coded on the basis of a mean error, 
and 

means (3) for searching the best match among 
the image blocks included in the restricted group of 
images by using the PDE method. 



(57) ABSTRACT 

The present invention relates 
to a method and system for performing 
motion estimation in video image com- 
pression. In accordance with the inven- 
tion, an associative memory device is 
used in motion estimation, and the group 
of the image blocks to be processed is 
restricted on the basis of a mean error 
and the best match is searched among the 
image blocks using the PDE method. 
Thanks to the invention, motion estima- 
tion may be performed via software in a 
regular PC environment and still more 
efficiently than before. 
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